Detecting feigned cognitive impairment using pupillometry on the Warrington Recognition Memory Test for Words.

OBJECTIVE: Pupillometry provides information about physiological and psychological processes related to cognitive load, familiarity, and deception, and it is outside of conscious control. This study examined pupillary dilation patterns during a performance validity test (PVT) among adults with true and feigned impairment of traumatic brain injury (TBI). PARTICIPANTS AND METHODS: Participants were 214 adults in three groups: adults with bona fide moderate to severe TBI (TBI; n = 51), healthy comparisons instructed to perform their best (HC; n = 72), and healthy adults instructed and incentivized to simulate cognitive impairment due to TBI (SIM; n = 91). The Recognition Memory Test (RMT) was administered in the context of a comprehensive neuropsychological battery. Three pupillary indices were evaluated. Two pure pupil dilation (PD) indices assessed a simple measure of baseline arousal (PD-Baseline) and a nuanced measure of dynamic engagement (PD-Range). A pupillary-behavioral index was also evaluated. Dilation-response inconsistency (DRI) captured the frequency with which examinees displayed a pupillary familiarity response to the correct answer but selected the unfamiliar stimulus (incorrect answer). RESULTS: All three indices differed significantly among the groups, with medium-to-large effect sizes. PD-Baseline appeared sensitive to oculomotor dysfunction due to TBI; adults with TBI displayed significantly lower chronic arousal as compared to the two groups of healthy adults (SIM, HC). Dynamic engagement (PD-Range) yielded a hierarchical structure such that SIM were more dynamically engaged than TBI followed by HC. As predicted, simulators engaged in DRI significantly more frequently than other groups. Moreover, subgroup analyses indicated that DRI differed significantly for simulators who scored in the invalid range on the RMT (n = 45) versus adults with genuine TBI who scored invalidly (n = 15). CONCLUSIONS: The findings support continued research on the application of pupillometry to performance validity assessment: Overall, the findings highlight the promise of biometric indices in multimethod assessments of performance validity.

Neuropsychologists' perspectives of chronic traumatic encephalopathy (CTE).

Objective: Chronic Traumatic Encephalopathy (CTE) has received significant media coverage as a major health concern for collision sport athletes and combat veterans. This survey study investigated neuropsychologists' perspectives of CTE.Methods: Neuropsychologists (N = 325) were contacted via electronic advertisement posted to popular neuropsychology professional listservs and completed a survey regarding their perspectives of: the proposed sequelae of repeated concussions, the strength of the CTE research base, and its media coverage.Results: Most respondents (91%) were at least somewhat familiar with the concept of CTE. Moderate uncertainty was reported (i.e. up to 30%) regarding the effects of repeated concussions. Most felt the research in support of CTE was unreliable (80%) and weak regarding claims that repeated concussions cause CTE (91%), independently cause behavioral/emotional/cognitive dysfunction (86%), or increase the risk for neurodegeneration (79%). Respondents agreed patients are concerned about CTE (92%), concerns are influenced by the media (96%) that presents a biased/alarmist view of CTE (96%), and patient recovery is influenced by their CTE beliefs (82%).Conclusions: There was strong agreement that the media presents an alarmist/biased view of CTE that influences patients concerns and outcomes following concussion. This presentation is incongruent with the perceptions of surveyed neuropsychologists who find the research in support of CTE to be weak and unreliable. More research is needed to determine the potential effects of repeated (sub)concussive events. As public knowledge will continue to be influenced by the media and health care professionals, future research should explore CTE perceptions across other health care disciplines.

Specificity of Embedded Performance Validity Tests in Elderly Veterans with Mild and Major Neurocognitive Disorder.

OBJECTIVE: This study explored the specificity of four embedded performance validity tests (PVTs) derived from common neuropsychological tasks in a sample of older veterans with verified cognitive decline and whose performance was deemed valid by licensed psychologists. METHOD: Participants were 180 veterans who underwent comprehensive neuropsychological evaluation, were determined to have valid performance following profile analysis/conceptualization, and were diagnosed with mild neurocognitive disorder (i.e., MCI; n = 64) or major neurocognitive disorder (i.e., Dementia; n = 116). All participants completed at least one of four embedded PVTs: Reliable Digit Span (RDS), California Verbal Learning Test-2nd ed. Short Form (CVLT-II SF) Forced choice, Trails B:A, and Delis-Kaplan Executive Function System (DKEFS) Letter and Category Fluency. RESULTS: Adequate specificity (i.e., ≥90%) was achieved at modified cut-scores for all embedded PVTs across MCI and Dementia groups. Trails B:A demonstrated near perfect specificity at its traditional cut-score (Trails B:A < 1.5). RDS ≤ 5 and CVLT-II SF Forced Choice ≤7 led to <10% false positive classification errors across MCI and dementia groups. DKEFS Letter and Category Fluency achieved 90% specificity at extremely low normative cut-scores. CONCLUSIONS: RDS, Trails B:A, and CVLT-II SF Forced Choice reflect promising embedded PVTs in the context of dementia evaluations. DKEFS Letter and Category Fluency appear too sensitive to genuine neurocognitive decline and, therefore, are inappropriate PVTs in adults with MCI or dementia. Additional research into embedded PVT sensitivity (via known-groups or analogue designs) in MCI and dementia is needed.

Comparing Detection of Alzheimer's and Vascular Disease-Related Cognitive Impairment With Brief Cognitive Screens.

Objectives: The study compared the accuracy of the Mini-Mental State Examination (MMSE) with its modified version (3MS) in distinguishing healthy older adults from adults with cognitive impairment due to suspected Alzheimer's disease (AD) or vascular disease (VaD). Method: Participants were 98 veterans who underwent comprehensive neuropsychological evaluation due to concern for cognitive decline. Participants were selected via retrospective chart review on the basis of diagnosis. They had diagnoses of mild or major neurocognitive disorder due to suspected AD (N=20), mild or major neurocognitive disorder due to suspected VaD (N=44), or no neurocognitive diagnosis (i.e., healthy adult comparisons; HC, N=34). Results: The 3MS demonstrated superior detection of cognitive impairment. The extent of this enhanced detection was influenced by the suspected etiology of cognitive impairment. The 3MS and MMSE had comparable discrimination of AD and HC. With respect to VaD, the 3MS showed superior discriminability compared to the MMSE. Conclusions: Overall, results support the adoption of the 3MS over that of the MMSE. The 3MS is a superior (and free) tool for detecting cognitive impairment in geriatric populations. Its use is recommended for first-line screening of cognitive symptoms in older adult populations, especially those with concern for VaD.

Utility of WAIS-IV Digit Span indices as measures of performance validity in moderate to severe traumatic brain injury.

Objective: The addition of Sequencing to WAIS-IV Digit Span (DS) brought about new Reliable Digit Span (RDS) indices and an Age-Corrected Scaled Score that includes Sequencing trials. Reports have indicated that these new performance validity tests (PVTs) are superior to the traditional RDS; however, comparisons in the context of known neurocognitive impairment are sparse. This study compared DS-derived PVT classification accuracies in a design that included adults with verified TBI. Methods: Participants included 64 adults with moderate-to-severe TBI (TBI), 51 healthy adults coached to simulate TBI (SIM), and 78 healthy comparisons (HC). Participants completed the WAIS-IV DS subtest in the context of a larger test battery. Results: Kruskal-Wallis tests indicated that all DS indices differed significantly across groups. Post hoc contrasts revealed that only RDS Forward and the traditional RDS differed significantly between SIM and TBI. ROC analyses indicated that RDS variables were comparable predictors of SIM vs. HC; however, the traditional RDS showed the highest sensitivity when approximating 90% specificity for SIM vs. TBI. A greater percentage of TBI scored RDS Sequencing < 1 compared to SIM and HC. Conclusion: In the context of moderate-to-severe TBI, the DS-derived PVTs showed comparable discriminability. However, the Greiffenstein et al. traditional RDS demonstrated the best classification accuracy with respect to specificity/sensitivity balance. This relative superiority may reflect that individuals with verified TBI are more likely to perseverate on prior instructions during DS Sequencing. Findings highlight the importance of including individuals with verified TBI when evaluating and developing PVTs.

Time and money: Exploring enhancements to performance validity research designs.

INTRODUCTION: The study examined the effect of preparation time and financial incentives on healthy adults' ability to simulate traumatic brain injury (TBI) during neuropsychological evaluation. METHOD: A retrospective comparison of two TBI simulator group designs: a traditional design employing a single-session of standard coaching immediately before participation (SIM-SC; n = 46) and a novel design that provided financial incentive and preparation time (SIM-IP; n = 49). Both groups completed an ecologically valid neuropsychological test battery that included widely-used cognitive tests and five common performance validity tests (PVTs). RESULTS: Compared to SIM-SC, SIM-IP performed significantly worse and had higher rates of impairment on tests of processing speed and executive functioning (Trails A and B). SIM-IP were more likely than SIM-SC to avoid detection on one of the PVTs and performed somewhat better on three of the PVTs, but the effects were small and non-significant. SIM-IP did not demonstrate significantly higher rates of successful simulation (i.e., performing impaired on cognitive tests with <2 PVT failures). Overall, the rate of the successful simulation was ∼40% with a liberal criterion, requiring cognitive impairment defined as performance >1 SD below the normative mean. At a more rigorous criterion defining impairment (>1.5 SD below the normative mean), successful simulation approached 35%. CONCLUSIONS: Incentive and preparation time appear to add limited incremental effect over traditional, single-session coaching analog studies of TBI simulation. Moreover, these design modifications did not translate to meaningfully higher rates of successful simulation and avoidance of detection by PVTs.

Performance validity testing via telehealth and failure rate in veterans with moderate-to-severe traumatic brain injury: A veterans affairs TBI model systems study.

BACKGROUND: The COVID-19 pandemic has led to increased utilization of teleneuropsychology (TeleNP) services. Unfortunately, investigations of performance validity tests (PVT) delivered via TeleNP are sparse. OBJECTIVE: The purpose of this study was to examine the specificity of the Reliable Digit Span (RDS) and 21-item test administered via telephone. METHOD: Participants were 51 veterans with moderate-to-severe traumatic brain injury (TBI). All participants completed the RDS and 21-item test in the context of a larger TeleNP battery. Specificity rates were examined across multiple cutoffs for both PVTs. RESULTS: Consistent with research employing traditional face-to-face neuropsychological evaluations, both PVTs maintained adequate specificity (i.e., > 90%) across previously established cutoffs. Specifically, defining performance invalidity as RDS < 7 or 21-item test forced choice total correct < 11 led to < 10%false positive classification errors. CONCLUSIONS: Findings add to the limited body of research examining and provide preliminary support for the use of the RDS and 21-item test in TeleNP via telephone. Both measures maintained adequate specificity in veterans with moderate-to-severe TBI. Future investigations including clinical or experimental "feigners" in a counter-balanced cross-over design (i.e., face-to-face vs. TeleNP) are recommended.

Detecting simulated versus bona fide traumatic brain injury using pupillometry.

Objective: Pupil dilation patterns are outside of conscious control and provide information regarding neuropsychological processes related to deception, cognitive effort, and familiarity. This study examined the incremental utility of pupillometry on the Test of Memory Malingering (TOMM) in classifying individuals with verified traumatic brain injury (TBI), individuals simulating TBI, and healthy comparisons. Method: Participants were 177 adults across three groups: verified TBI (n = 53), feigned cognitive impairment due to TBI (SIM, n = 52), and heathy comparisons (HC, n = 72). Results: Logistic regression and ROC curve analyses identified several pupil indices that discriminated the groups. Pupillometry discriminated best for the comparison of greatest clinical interest, verified TBI versus simulators, adding information beyond traditional accuracy scores. Simulators showed evidence of greater cognitive load than both groups instructed to perform at their best ability (HC and TBI). Additionally, the typically robust phenomenon of dilating to familiar stimuli was relatively diminished among TBI simulators compared to TBI and HC. This finding may reflect competing, interfering effects of cognitive effort that are frequently observed in pupillary reactivity during deception. However, the familiarity effect appeared on nearly half the trials for SIM participants. Among those trials evidencing the familiarity response, selection of the unfamiliar stimulus (i.e., dilation-response inconsistency) was associated with a sizeable increase in likelihood of being a simulator. Conclusions: Taken together, these findings provide strong support for multimethod assessment: adding unique performance assessments such as biometrics to standard accuracy scores. Continued study of pupillometry will enhance the identification of simulators who are not detected by traditional performance validity test scoring metrics. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

Performance validity assessment using response time on the Warrington Recognition Memory Test.

OBJECTIVE: The present study tested the incremental utility of response time (RT) on the Warrington Recognition Memory Test - Words (RMT-W) in classifying bona fide versus feigned TBI. METHOD: Participants were 173 adults: 55 with moderate to severe TBI, 69 healthy comparisons (HC) instructed to perform their best, and 49 healthy adults coached to simulate TBI (SIM). Participants completed a computerized version of the RMT-W in the context of a comprehensive neuropsychological battery. Groups were compared on RT indices including mean RT (overall, correct trials, incorrect trials) and variability, as well as the traditional RMT-W accuracy score. RESULTS: Several RT indices differed significantly across groups, although RMT-W accuracy predicted group membership more strongly than any individual RT index. SIM showed longer average RT than both TBI and HC. RT variability and RT for incorrect trials distinguished SIM-HC but not SIM-TBI comparisons. In general, results for SIM-TBI comparisons were weaker than SIM-HC results. For SIM-HC comparisons, classification accuracy was excellent for all multivariable models incorporating RMT-W accuracy with one of the RT indices. For SIM-TBI comparisons, classification accuracies for multivariable models ranged from acceptable to excellent discriminability. In addition to mean RT and RT on correct trials, the ratio of RT on correct items to incorrect items showed incremental predictive value to accuracy. CONCLUSION: Findings support the growing body of research supporting the value of combining RT with PVTs in discriminating between verified and feigned TBI. The diagnostic accuracy of the RMT-W can be improved by incorporating RT.

Detecting feigned traumatic brain injury with eye tracking during a test of performance validity.

OBJECTIVE: Eye-tracking is a promising technology to enhance assessment of performance validity. Research has established that ocular behaviors are reliable biomarkers of (un)conscious cognitive processes, and they have distinguished deceptive from honest responding in experimental paradigms. This study examined the incremental utility of eye-tracking on a clinical performance validity test (PVT) in distinguishing adults with verified TBI from adults coached to feign cognitive impairment. METHOD: Participants were 49 adults with moderate-to-severe TBI (TBI), 47 healthy adults coached to simulate TBI (SIM), and 67 healthy comparisons providing full effort (HC). A PVT linked to eye-tracking was completed in the context of a full neuropsychological battery. RESULTS: Kruskal-Wallis tests revealed that eye-tracking indices did not differ among the groups during presentation of stimulus items but did differ during forced-choice trials. Compared to TBI and HC, SIM had significantly more transitions, fixations, and time spent looking at correct and incorrect response options. Logistic regressions and ROC curve analyses showed that accuracy was the best predictor of SIM versus HC. For SIM versus TBI, eye-tracking indices exceeded accuracy in distinguishing the groups. Eye-tracking added incremental predictive value to accuracy for both SIM-HC and SIM-TBI discriminations. CONCLUSION: Eye-tracking indicated that persons feigning TBI showed multiple signs of greater cognitive effort than persons with verified TBI and healthy comparisons. In the comparison of greatest interest (SIM vs. TBI) eye-tracking best predicted group status and yielded excellent discrimination when combined with accuracy. Eye-tracking may be an important complement to traditional accuracy scores on PVTs. (PsycINFO Database Record (c) 2020 APA, all rights reserved).

Detecting malingering in traumatic brain injury: Combining response time with performance validity test accuracy.

OBJECTIVE: The present study examined the incremental utility of item-level response time (RT) variables on a traditional performance validity test in distinguishing adults with verified TBI from adults coached to feign neurocognitive impairment. METHOD: Participants were 45 adults with moderate to severe TBI, 45 healthy adults coached to feign neurocognitive impairment (SIM), and 61 healthy adult comparisons providing full effort (HC). All participants completed a computerized version of the Test of Memory Malingering (TOMM-C) in the context of a larger test battery. RT variables examined along with TOMM-C accuracy scores included mean RTs (Trial 1, Trial 2, correct and incorrect trials) and RT variability indices. RESULTS: Several RT indices differed significantly across the groups. In general, SIM produced longer, more variable RTs than HC and TBI. Of the RT indices, average RT for Trial 1 and 2 were the best predictors of group membership; however, classification accuracies were greatly influenced by the groups being compared. Average RT for Trial 1 and 2 showed excellent discrimination of SIM and HC. All RT indices were less successful in discriminating SIM and TBI. Average RT for Trial 1 and 2 added incremental predictive value to TOMM-C accuracy in distinguishing SIM from TBI. CONCLUSION: Findings contribute to a limited body of research examining the incremental utility of combining RT with traditional PVTs in distinguishing feigned and bona fide TBI. Findings support the hypothesis that combining RT with TOMM-C accuracy can improve its diagnostic accuracy. Future research with other groups of clinical interest is recommended.

Strategies of successful and unsuccessful simulators coached to feign traumatic brain injury.

OBJECTIVE: The present study evaluated strategies used by healthy adults coached to simulate traumatic brain injury (TBI) during neuropsychological evaluation. METHOD: Healthy adults (n = 58) were coached to simulate TBI while completing a test battery consisting of multiple performance validity tests (PVTs), neuropsychological tests, a self-report scale of functional independence, and a debriefing survey about strategies used to feign TBI. RESULTS: "Successful" simulators (n = 16) were classified as participants who failed 0 or 1 PVT and also scored as impaired on one or more neuropsychological index. "Unsuccessful" simulators (n = 42) failed ≥2 PVTs or passed PVTs but did not score impaired on any neuropsychological index. Compared to unsuccessful simulators, successful simulators had significantly more years of education, higher estimated IQ, and were more likely to use information provided about TBI to employ a systematic pattern of performance that targeted specific tests rather than performing poorly across the entire test battery. CONCLUSION: Results contribute to a limited body of research investigating strategies utilized by individuals instructed to feign neurocognitive impairment. Findings signal the importance of developing additional embedded PVTs within standard cognitive tests to assess performance validity throughout a neuropsychological assessment. Future research should consider specifically targeting embedded measures in visual tests sensitive to slowed responding (e.g. response time).